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This study foc»:sed on f:'ve major activities: (1) 
developing an achievement test to measure visual diagnostic ability 
of television service technicians, (2) assessing the independence of 
the dimension of visual diagnostic ability, (3) comparing the iconic 
equivalence of photographs with motion cues and live screen 
presentations of defective television pictures for testing purposes, 
(4) ascertaining if static and dynamic tests are measures of a single 
dimension, and (5) assessing the reliability of the two tests. Static 
and dynamic tests were administered to 89 students who were 
completing 1-year programs in radio-television servicing, and to 24 
radio-television technicians. A panel of radio-television instructors 
and technicians wrote the questions and judged the appropriateness of 
items for the test. Several hypotheses were analyzed as results of 
the tests. A copy of the directions for the tests, and computer 
printouts are appended. (AG) 
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PREFACE 



One of the primary aims of a ceai.her's lessor, structure should be 
to present material m such a way that the students can not only repeat 
accurately the facts learned, but also apply the principles in a practical 
situation. It IS to be hoped that this p. ctice would be maintained in 
tields ranging from applied mathematics to driver education. The point is 
to be able to relate facts learned in the classroom to problems existing 
outside the classroom. 

• Inherent in this kind of preparation is the assumption that Che 
material presented to the students is a true and realistic representation 
of knowledge to be of use in everyday situations A film used in a driver 
education c^Lass to illustrate traffic hazards will be of . > benefit ac all 
if it does not depict realistically those dangers the driver will find on 
Che highway. Similarly, an auto mechan ic - to-be cannot be expected to 
recognize a fau'ry generator if the model used in the classroom is not a 
faithful representation of the real thing. 

This technical paper presents still another dimension of the equi- 
valence of training and practice in industry. The field is television 
repair, and this multi-purpose Fludy delves into several aspects of the 
training, testing, and performance of the television service technician. 

The author wishes to thank Dr Thomas Baldwin for his time in ad- 
vising the author and reviewing the manuscript; Mr, Alvin Stumpf of R. W, S 
Industries, Cleveland. Ohio, who generously loaned the Tele-Lab used in 
administering cbe tests described herein; and the Sears -Roebuck Training 
Center, Chicago, Illinois, for giving up valuable training time so that 
their technicians could be tested. The author and the Center are grate- 
ful to Dr. Joe R, Clary, Executive Director of the North Carolina State 
Advisory Council on Vocational Education, for bis pre-publication review 
of the manuscript. Appreciation is also expressed to Mrs. Sue King for 
editing the manuscript. Kiss Becky Beckler for typing the final copy, and 
the entire Center clerical and technical staff for the assistance in the 
production of the final report. 



John K. Coster 
Director 
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CHAPTliR I -y,^ 

INTRODUCTION 

Nat ure of the Problem 

One of the most important jobs a television service technician 
performj is diagnosis. Obviously, the technician does many other things, 
but unless: he can perform this first step he is essentially useless as 
a technician. It does not take exceptional skill or knowledge to test 
vacuum tubes, solder wires, replace components, etc. Most people can 
be taught to do these things in a very short time; however, it does take 
considerable knowledge and skill to clLagnose problems that occur in 
television receivers. Anyone who has closely observed a technician 
servicing a television set has seen the technician constantly observing 
the picture from the set as he performs certain checks, makes adjust- 
ments, or replaces components. The quality of the picture is a constant 
reference point in servicing a television receiver. The video (picture) 
and audio (sound) are the end products of the set^s circuitry, and their 
quality is really the technician's major concern. In fact, he is 
highly concerned with both normal and defective reception and must be 
able to distinguish between them. One dealer estimates that 25 percent 
of all service calls involve normal reception ("Education and Inventory/' 
1969). 

The inherent circuit characteristics of television receivers are 
such that the signal progresses through the set in a systematic manner 
generally characteristic of all television receivers, e.g., all tele- 
vision circuits contain low and high voltage, power supplies, horizontal 
and vertical oscillator, I, F, , and audio and video stages. These 
stages are interconnected, and their final product is the video and 
audio output in the form of picture and sound. If some stage (or parts - 
of a stage) in the receiver malfunctions, it will affect the quality of 
the picture in some manner which is quite characteristic; e.g., a mal- 
functioning vertical oscillator can cause the picture to roll or move 
vertically, lack of high voltage will cause the screen to go dark, 
AC current leaking into the audio will cause a hum in the sound, etc. 
This visual cue in the picture and/or audio cue in the sound immedi- 
ately tells the technician which stage or stages he should examine in 
the se.t to locate the troubxe; that is, it narrows the field of his 
search for the faulty component (s) . Obviously, the technician uses 
other skills and knowledges in locating malfunctions in a television 
receiver, but visual diagnosis is always first. All malfunctions 
could, in theory, be diagnosed and located with an oscilloscope and 
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other test equipment. In practice, however, this just is not done 
because it is easier and quicker to look at the picture tube for these 
cues since the television receiver acts as its own test equipment. 
However the technician must be able to read the screen just as he must 
be able to read a voltmeter or oscilloscope Instructional programs for? 
training television, technicians teach the use of these cues systemati- 
cally and/or incidentally— it can hardly be escaped Yet there is 
little or no' effort to measure this visual diagnostic ability in eval- 
uating technicians graduating from technical training programs A 
cyrsory survey of the market reveals only one or two television chassis 
with switchable defects wired in so that they may be used for testing 
and/or teaching purposes Some instructors wire their own sets, but 
this is expensive and time consuming, More often, only the instructor's 
opinion enters into the evaluation of the student technician's ability 
to visually diagnose television malfunctions. Yet if we are to gel a 
complete assessment of the ability of the technician, all dimensions of 
his ability must be measured, A fairly large number of research studies 
have been made of electronic troubleshooting; however, none has been 
addressed to the task of assessing the visual diagnostic ability of 
television service technicians 

Another method of presenting defective television pictures to 
technicians for testing purposes is photography Photographs have many 
advantages over the live television screen for testing purposes. They 
are smaller^ more convenient, cheaper to produce in large quantities, 
more consistant easily transportable and more reliable. (Electronic 
equipment malfunctions; photographs do not.) Many electronic textbooks, 
trade magazines, and trouble-shooting pamphlets for the layman use pho- 
tographs for these reasons The question of the equivalence- of the 
photographs to the live picture should be asked--how good are these 
photographic substitutes? They obviously lack the motion found in a 
live television picture, but if they are of high quality and of suffi- 
cient size to resolve the picture detail; they contain all of the 
remaining information in the picture since they are an exact copy. The 
books and pamphlets mentioned previously do, in fact, contain supple- 
mentary statements wherever necessary which are indicative of any motion 
in the picture/e.gv, rolling ^.icture, jumping picture, etc. If the 
qualifications of si2e> quality, resolution^ and motion cues are given, 
we would expect the photographs to be equivalent, or nearly so, to the 
live screen presentation for testing purposes. No studies have been 
made of the relationship between photographs with paction cues and a live 
screen television picture. It is imperative thcr t^e question of equiv- 
alence be answered for economic and logistic reasons if the dimension 
of visual diagnostic ability is to be testeu extensively. 



P urpose of the Study 



This study was an attempt to answer several basic questions with 
regard to an additional dimension of the performance of television 
service technicians and the equivalence of two methods of presenting 
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defective television recepr.ion for testing purposes. The first pur- 
pose of the study was to develop a test to measure an additional 
dimension of the performance of the television service technician 
which is not being measured by a conventional paper and pencil test- 
visual diagnostic ability. The second purpose of the study was to 
assess the independence of the dimension of visual diagnostic ability 
from the knowledge which is normally measured by paper and pencil 
tests. The third purpose of the study was to develop a parallel form 
of the test in order to compare the iconic equivalence of photographs 
with verbal motion cues and live screen presentations of defective 
television pictures for testing purposed. Iconicity is defined as the 
degree of realism with which an object represents the real object. One 
can scale objects according to their iconicity. In the case of tele- 
vision pictures, the scale might be: line drawings, shaded line draw- 
ings, still photographs, and motion pictures. In each case as the 
degree of iconicity increases, the representation is more like' the real 
object. The fourth purpose of the -.cudy was to ascertain if the static 
and dynamic tests are measures of a single dimension, and, further, if 
they are both measures of the same dimension. The fifth purpose of the 
study was to assess -the reliability and validity of the two tests. 

Limitations of the Study 

The study was limited to attempting to develop parallel forms of 
an instrument for assessing the existence and independence of the dimen- 
sion of visual diagnostic ability of graduating television servicing 
technicians and assessing the iconic equivalence of two methods of pre- 
senting defective pictures. No attempt was made to assess all of or 
the relative importance of the dimensions of troubleshooting ability. 
Since this study was an attempt to answer basic questions about visual 
diagnostic ability and iconic equivalence, and due to the cost of equip- 
ment and logistics of testing, only a sampling of black and white vacuum 
tube-type television receiver malfunctions were used. No attempt was 
made to test the visual capacity of the -echnicians or students tested. 
Visual testing would have created additional logistic and financial 
problems, and there was no reason to suspect that any of the students 
or technicians tested had any visual impairment which might affect their 
performance on the tests. It seemed reasonable that visual impairment 
to this extent would have eliminated those affected from the training 
programs or from the occupation. No attempt was made to establish the 
minimum acceptable size of photographs. High quality photographs of 
sufficient size to allow resolution of single scan lines were assumed 
to be adequate. 
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LITERATURE SURVEY AND bi/^rEME^H' OF HYPOTHESES 



LLtoraturo Survey 



The value of performance testing has been recognized for cen'- 
Curies. Performance tests are effective, have great realism, and a 
close relationship to job-like measures. They have high face validity 
(Evans and Smith, 1953) and are intrinsically valid (Fattu, 1956, p, 3). 
One of the earliest records of performance testing goes back to Biblical 
times. Jeph«-hah (Judv 12 15) used the password "Shibboleth" because he 
knew Che enemy could not pronounce the sound "sh". All those fugitives 
at the Jordan fords who said Sibboleth were promptly killed. It was a 
very effective test (Fattu, 1956, p. 2). Performance tests do have 
some serious drawbacks, though. They usually cost more, consume more 
time to administer, and allo\>? only a limited sampling of the tasks the 
individual should be able to do (Lofkowith, 1955, p* 17) « Their advan- 
tages, however, outweigh heir disadvantages. Their big advantage is 
that they appear to measure an additional dimensio^^ of the criterion. 

It has been shown many times through research that human ability 
is multidim<5nsional and, indeed, rhat dimensions may have subdimensions. 
Such is the case with electronic troubleshooting ability. Saupo con- 
cluded that some but not all variance due to individual differences in 
troubleshooting can be predicted from basic knowledge (Saupe, 1954, 
P|i« 74-75) V If, in fact, this is the case, in order to assess the 
criterion adequately we must sample all dimensions of the criterion, 
not merely those dimensions that are easy or convenient to measure. 
Even though the importance and the need for performance tesi ^ have been 
recognized, their development has lagged behind. This is especially 
true in the vocational-technical field; yet this is one area that should 
be making wide use of performance tests since most of the abilities with 
which we are concerned require more than just cognitive knowledge. 
Instead of developing performance tests, other forms of tests have been 
substituted that ai'e cheaper and easier to develop and administer. 
Electronic troubleshooCLng, in particular television troubleshooting, 
is no exception. Sometimes pictorial tests have been substituted for 
performance tests which use actual equipm-jnt, but even these are rather 
rare (Lefkowith, 1955, p. I). 

Saupo (1954) identified troubleshooting as one of the most 
crucial and difficult jobs of the electronic technician. Standlee 
£t aj., (1956) report that according to the Navy electronic technicians* 
handbook, troubleshooting ability is a sort of sixth sense which is 
acquired with experience. If this is the case, it leuds even more 
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support to the logic Jor testing this dimoTisioru The ability to tvouble- 
shoot electronic equipment is a critical job leqtjrament for electronics 
technicians; yet the research shows that nhere has been heavy reliance 
on paper and pencil tescs vhich may not measure this dimtaSAont Ther^ is 
strong evidence th< L such tests measure principally verbal cc. ^.snc p-.^u tVt 
visual uests are needed to measure visual content (Holmes, 195V> p. 76). 

There has been much research done in the area of electronic ' 
troubleshooting. The vast majority of these studies have been mad^i 
for the military and are concerned primarily with specific military 
applications such as maincenance of radio and raiar equipment. The 
three largest categories of this electronic research are proficiency 
assessment tachr.iques, training equipment cr materials, and analysis 
of job activities. Other categories are evaluation of maintenance 
personnel, experimental, and general* There have also been many trouble- 
shooting tests developed which can be categorized ii^to (1> on-the-job ' ^ 
measures, (2) performance tests, (3} simulator tests, (^f) ARC (Automatic 
Recording of Checks) tests, and (5) paper and pencU tests* 

Miller and Folley (1951) define troubleshooting as a Ic-gical pro- 
cedure in elimrnatmg the alternative possibilities in dia»|nosing the 
cause of a symptom or group of symptoms. The technician does this by 
performing appropriate ^hecks, by a logical or systematic procedure, or 
from probability data. It should be recognized, however, that before 
the technician can troubleshoot a given piece of e^cjuipment, he mi»st 
first be able to recognize (discrimiuate) tnat the symptom or problem 
exists, i,e,, he must know the operating characteristics of the equip- 
ment well enough to recognize abnormal operatic.i under the usual operat- 
ing conditions of the equipment. One study points up quitf* w:5ll the 
process involved in troubleshooting as well as the importance .of the 
ability oJ: the electronics technician to troubleshoot electi.onic equip- 
ment* 7n this study the investigator had elect x-onics technicians rank 
the abilities they felt their joba required* He concl-jded that the 
first three critical requirements of electronics technix":ians are to 
(1) make simple discriminations, (2) make decisions contingent upon 
these discriminations, and (3) analyze and trace circuits (Standl^e et 
air, 1956) ♦ Although most of the troubleshootirg research and vests 
deal wilh specific military problems ar^d are not pertinent to this 
study, there are a number of findings which are ir.portant. 

Many people have observed and studied technicians' troubieshoot- 
ing equipment and have noted the wide differences the ability of the 
technicians to diagnose quickly and/or successfv.lly malfunctioning equip- 
ment. Bryan £t al. (1956) made such an observation. Saupe (1954) 
observed technicians troubleshooting a superheterodyne rad«o and con- 
cluded that basic knowledge predicts some but not ail of the individual 
differences in troubleshooting proficiency and that good tr.>ubieshootcrs 
know more about the functional relationships between components than do 
poor troubleshooters. Acquisition of sufficient information to locate 
the defective stage does not guarantee a correct solution, but it does 
increase the chances of success* Highland and others concluded that 
successful troubleshooters do not necessarily make fewer checks. In 
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fact, there is no pavtlcilar advantage in accompHsliLng a large number 
of checks before resrricting the checking to a single stage of the 
equipment. However, a tendency to nake more checks in %jrir.gxng" out 
a stage improves a man's chances for locating the trouble.. The nearer 
a man's first component relaceinent is to_.the defective component, the 
more Ukely it if: that he v7iil eventually find the trouble^ Interviews 
conducted x^ith troubl eshooters suggested that rapid solution of trouble- 
shooting problems is associated with logical analysis and thinking out 
the problem, knowledge of the equipment, past experience with the partic- 
ular malfunccLon. and proper utilization of test equipment (Saltx and 
Moore. 1953). 

The research presented thus far indicates that troubleshooting 
ability is a critical duty of the technician and that there are large 
individuar differences in this ability among technicians*, Basic knowl- 
edge accounts for some but not all of these differences, and successful 
troubleshooters cannot necessarily be identified by the number of checks 
made. Successful troubleshooting is contingent upon making discrimina- 
tions, making decisions based upon these discriminations^ and tracing 
and analyzing circuits. Also, visual tests should be used to measure 
visual conteiit^ 

In the specific case of the television service technician, the 
troubleshooting process starts with discriminations about picture qual- 
ity or lack of picture and proceeds to the second step, that of making 
decisions based upon the discriminations, i.e., identification or recog- 
nition of the symptoms follotv^ed by elimination of possible causes^ 
Glaser Damrin and Gardner developed a ARC (Automatic Recording of 
Checks)-type televis ion troubleshooting test for a problem-solving 
research study. Verbal descriptions were us-^d as the means of indicat- 
ing picture quality (Fattu, 1956). However, when performance testing, 
the prime testing device is the actual equipment in its normal setting. 
When this is not feasible, a simulator or pictorial test should be sub- 
stituted Ov'ulfeck and Taylor, 1957). Uris (1955) found that three- * 
dimensional models and actual equipment were both better than two- 
dimensional aids in teaching complex motor skills^ Lefkoi^rith (IS55) 
studies the iconic relationship of various methods of teaching and ' 
testings He deiines iconicity as realism, or the degree to t^jhich 
pictorial signs or s>'mbois are similar to the objects signified. Ke 
concluded that pictorial tests measure learning best v;hen th^ testing 
device is as nearly Like the actual equipment as possible and that the 
testing should be done with the same equipment or pictorial representa- 
tion as used in teachings He further concludes that there is a practi- 
cal limit beyond which increased reality in a pictorial test will not 
result in increased validity and that there is a point beyond which a 
higher iconic level will not add relevant learning (or testing) cues. 
Motion picture films and kinescopes have been found to be almost as 
effective as conventional means in teaching classes (Holmes • 1959). 
Motion pictures, if of sufficient quality, should contain all of the 
relevant information presented by an actual television screen; hov/ever, 
^hese are expensive to produce. Still photographs are reasonably cheap 
and easy to reproduce but lack motion and are one step more removed 
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iconically from the live television screen. If the iconic level of 
photographs wich motion cues xs sufficiently high, these would provide 
a cheaper, more convenxeut, and more reliable method of testing the 
visual diagnostic abilxty of television technicians^ This question 
has not yet been researched fullyc 

In testing the visual diagnostic ability of television techni- 
cians, one cannot escape certain questions pertaining to vision. One 
of these is the relationship between static and dynamic vision* Burg 
(1966) has made an extensive study of California drivers' static and 
dynamic vision- Studies of this nature typically use a target moving 
in an arc in front of the subject's eyes with the speed and direction 
of the target varying ^ He found that (1) acuity declines with the 
speed of the target, (2) there is a high correlation between static and 
dynamic vision, and (3) the correlation decreases as the target speed 
increases (December, 1964). Ludwigh and Miller concluded that visual 
acuity is largely dependent upon the efficiency of the overall ocular 
pursuit mechanism of the individual and that not all persons with good 
static acuity are equally good in dynamic acuity (Bartley, 1958). 
Dynamic vision may be a critical variable when' comparing photographs 
with a live television screen. This has not yet been researched. Since 
the motion that may be present iu the picture of a malfunctioning tele- 
vision receiver approaches a static condition and since the relevant cue 
is motion rather than the speed of motion, it seems reasonable that if 
photographs of a television screen are supplemented with motion cues, 
they should be essentially equal to the live screen presentations. 

Visualj)jBrception has been researched by Von Send en, Bailley, 
Forgus, Gibson, Vernon, and others. Von Senden reports that perception 
is multidimensional, with dimensions of space, size, form, brightness, 
color, etc* In studying persons who were given sight for the first 
time. Von Senden found that differences in the dimensions of color and 
brightness could be detected immediately; however, practice was required 
before other dimensions could be accurately discriminated (Riesen, 1947). 
In other words, learning takes place as a result of practice. Gibson 
and Gibson concluded that perceptual learning leads to increased speci- 
ficity or differentiation of the perceptual act, i.e., the individual 
becomes more sensitive to the variables of the stimulus array. 
VanderMeer (1953) concluded that students improve their ability to learn 
from films as they have more practice in viewing films. Zuckerman and 
Rock (1957) , Forgus (1966) , Dember (1964) , and Birch (1945) also con- 
clude that perceptual learning increases with experience. Since 
experience plays an important part in visual perception, we would 
expect that experienced technicians would tend to score higher than 
graduating technicians on a visual diagnostic test of malfunctioning 
television receivers since they have had a greater amount of experience 
(Fehrer, 1935, and Dickinson, 1926), 

Wlien testing using a live television screen, the viewing position 
and distance from the screen may be critical. In studying instructional 
television programs. Holmes (1959) found that the maximum number of 
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students viewing one screen should be approximately equal to the screen 
size expressed in feet. He also found no difference in achievement in 
students sitting in the front, middle, or rear of the room when the 
minimum and maximum distances from the screen were the screen size 
expressed in feet and twice the screen size in feet, respectively- 

5LL* (1953; found the optimum viewing area of a rear projection 
daylight screen to be a ^60 degree cone, 12 screen widths deep, 
expressed in feet. When servicing a television set", a technician 
typically views the set from close range primarily because he must be 
close in order to work on uhe set^ As long as the malfunctions pre- 
sented are such that they do not require observation of individual 
Scan lines^ e.g^, focus problems it v/ould seem reasonable to expect 
that viewing conditions similar to those for instructional television 
and rear projection equipment should be adequate, although it would 
seem advisable to restrict the maximum distance as much as practi- 
cable,. 

It should be noted that troubleshooting as previously defined 
requires three sceps-"discrimination, decision-making, and circuit 
tracing and analysis^ For purposes of this study a distinction will 
be made between diagnosis and troubleshootings Diagnosis as used here 
refers to the first two sceps^-discrimination and decision-making. 
This process isolates one stage or a series of stages in order of 
probable fault v/ithin which further isolating checks can be made. In 
so^r* cases it might pinpoint a single component. Troubleshooting is 
.aKen to mean the entire process which includes the additional step of 
circuit tracing and analysis to isolate the defective component (s) . 
Thus, visual diagnostic ability of the technician refers to his 
ability to look at a television screen, make discriminations, and then 
make decisions about these. discriminations, i.e., he must be able to 
look at the screen^and T-ecognize normal or abnormal reception and then, 
if the reception is abnormal, make a decision about the probable source. 



Statement of Hypotheses 

The following research hypotheses were formulated based upon the 
research studies just cited. 

Ic Visual diagnostic ability exists as a reliable dimension as 
measured by the static test* 

2. Visual diagnostic ability exists as a reliable dimension as 
measured by the dynamic test^ 

3. As measured by the static test, visual diagnostic achieve- 
ment of television technicians employed full time in' the 
occupation will b*/ significantly better than the visual 
diagnostic ability of students completing training. 
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4. As measured by the dynamic test, visual diagnostic 
achievement of television technicians employed full time ^ 
in the occupation will be significantly better than the 
visual diagnostic achievement of students completing 
training. 

5. There is no significant difference in iconicity between 
photographs with verbal motion cues and live set 
presentations of malfunctions in visually diagnosing 
television receiver malfunctions. 

6. Visual diagnostic ability as measured by the static test 

is independent of other trade-related knowledge as measured 
by a paper and pencil test of knowledge of basic electronics. 

7. Visual diagnostic" ability as measured by the dynamic test is 
independent of other trade-related knowledge as measured by 
a paper and pencil test of knowledge of basic electronics. 

8. Visual diagnostic ability as measured by the static test 
represents essentially a single dimension. 

9. Visual diagnostic ability as measured by the dynamic test 
represents essentially a single dimension. { 

10. The static and dynamic tests measure the same dimension. 
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CliAFl'ER III 



EXPERIMENTAL PROCEDURE 



Restatement of the Problem 

This study was an- attack on several basic questions regarding 
the assessment of an additional dimension of achievement of graduating 
student television service technicians and the iconic equivalence of 
photographs with verbal motion cues and the live screen as methods of 
presenting defective television reception for testing purposes. , The 
first part of the problem was to develop a test to assess the additional 
dimension of visual diagnostic ability which is not normally measured 
with a paper and pencil test^ The second part of the problem was to 
develop a parallel test to assess the iconic equivalence of *{)hotographs 
with verbal motion cues and live screen presentations of defective 
television reception for testing purposes. The third part of the prob- 
lem was to assess the independence of visual diagnostic ability from 
that which is normally measured by conventional paper and pencil tests. 
The fourth part of the problem was to assess the visual diagnostic 
dimension with regard to its being a single valid and reliable dimen- 
sionv Some of the basic relationships to be studied are sho\>7n diagram- 
ma tically as follows: 

knowledge of basic electronics 
paper and pencil test 

t . t 

visual diagnostic ability visual diagnostic ability 

live screen ^ — ^ photograplis with verbal 

motion cues 



Test and Equipment Development 

A panel of radios-television instructors and technicians from 
North Carolina and Illinois wrote the items -f or the tests and judged 
their appropriateness^ The panel had been previously employed by the 
Achievement Measures Project to write a standardized radio-television 
service curriculum to be used in one*year technical training programs 
in radio and television service* The panel was also responsible for 
writing an achievement test for radio-television servicing* This was 
a paper and pencil test of knowledge of basic electronics^ It is 
referred to h'^ere as the RTV test and is used in part of the analysis 
of this study (Baldwin, 1968). Items were written and judged for 
appropriateness by the panel. Those items upon which there was 



10 



greatest agreement and which could be suitably wired into a set 
retained for use in the tests. 



Malfunctions used were wired into a television chassis so that 
they could be switched into and out of the circuit at the appropriate 
time. The unic'chosen for this purpose was a Tele-Lab instructor 
model manufactured and supplied by R. W. S. Industries, Cleveland, Ohio. 
The trainer is approximately four feet high by 22 inches wide and 16 
inches deep* A 16-inch picture tube is mounted near the top with the 
chassis mounted near the bottom. An auxiliary chassis and panel ^were 
mounted on the unit in front of the main chassis to carry the switches 
and necessary components to switch in malfunctions* Except for the 
means of presenting malfunctions, the static and dynamic tests are iden- 
tical. Twenty-seven different malfunctions were used with 50 multiple- 
choice questions based on these malfunctions. Some malfunctions were 
used for more than one question since they are more common. For pur- 
poses of this study only black and white tube type malfunctions were 
used. Two further restrictions on the malfunctions used were: they 
had to be switchable into the circuit of the set without destroying' the 
set; and they had to be compatible with the set circuitry, e.g., low 
DC restorer voltage problems could not be used since the set uses B-f 
boost, A standard test pattern was used as the video signal so that the 
same signal was fed into che television set in all instances. A B&K 
1076 television analyst was used for this purpose. 

Audio cues are sometimes used in the diagnosis of a set and could 
normally be heard from a live set but obviously would be lacking in 
photographs. £o control this variable the audio portion of the set was 
blocked out so that no audio signal could be heard. A statement on the 
condition of the audio was included in each question in both the static 
and dynamic testSe Statements such as normal audio, hum in audio, weak 
audio, distorted audio, etc*- were used. 

A question in the static test would read as follows: 
1. The laost likely cause of the malfunction in Figure #1 with normal 
audio is: 

' A. defective vertical oscillator stage 

B. defective high voltage rectifier 

C. defective horizontal output stage 

D. defective DC restorer stage 

The same question in the dynamic test would read: 

1. The most likely cause of the malfunction presented on the screen 
with normal audio is: 

A. defective vertical oscillator stage 

B, defective high voltage rectifier 
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C. defective horiaontaL output stage 

- ^ D, defective restorer stage 

The screen on the trainer was utilized as the photographic model 
for the static test^ Malfunctions were • switched into the circuit, and 
then the screen was photographed on 3 X 5 film. The negatives were 
then masked, two to a page, with just the screen and bezel of the set 
showing.. Photographic prints were made and inserted in the test so 
that the photograph I'es directly opposite the question pertaining to 
the photograph. Screen size in the photographs is approxi^nately 
2 3/4'^ X 3 l/2"o The photographs used in the static test were of high 
quality with individual scan lines easily discernible, A normal screen 
photograph was placed in the front, of the static test for reference 
purposes. 



The Sample 



The static and dynamic tests were administered to 89 students 
and 24 technicians^ All the students were completing one-year technical 
post -high school training programs in radio-television servicing^ The 
students were enrolled in ten technical institutes across North Carolina 
and one in South Carolina* These schools were using the standardized 
radio-television curriculum written by the panel, and they had also 
been visited by the staff of the Achievement Measures Project to ensure 
that the curriculum being taught in all of the schools was the same. 
The RTV test was also administered to the students, but at a different 
sittings 

All the technicians were employed full-time as technicians in 
television service departments^ TWelva of them were attending a special 
inservice training program at the Sears -Roebuck training center in 
Chicago^ They came from Michigan, Wisconsin, Illinois^ and Indiana, 
Twelve other technicians were tested from the local community of 
Champaign-Urbana , Illinois. These technicians were paid to take the 
tests^ ; ■ " 



Test Administration 



Since the trainer was transported from school to school and local 
conditions varied, it was necessary to warm up and tune the equipment at 
each administration- of the test. This was'done in the absence Of the 
subjects^ The test was administered in normally lighted electronics 
laboratories^ or classrooms equipped V7ith arm chairs for writing. Since 
the groups were small it was relatively easy to seat the subjects with- 
in the 60 degree cone, 32 feet deep, that is ideal for viewing tele- 
vision^ The subjects were asked if they could see the screen satis- 
factorily, and when all were satisfied, the general directions for the 
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test were read to the group. (See Appendix A J The subjects were then 
told that they could expect three kinds of malfunctions, those which- 
affect only the video, those which affect only the audio, and those 
which affect both the audio and videot The test was then started with 
each malfunction being switched on for one minute for each question it 
involved • This was followed by a few seconds of display of the normal 
picture before switching in the next malfunction* The screen was 
covered while the malfunctions were switched into the circuit, 'Upon 
completion of the dynamic test, the static tesr was* administered in a 
similar manner except that the subjects were able to work at their own 
rate since the malfunctions were presented by photographs • 

The trainer generally performed excellently .throughout the test- 
ing. Humidity and local conditions affected the trainer, but these 
effects were counteracted by letting the set warm up, followed by tun- ' 
ingt Only once did a malformation occur during testing • A solder 
joint broke allowing a wire to drop off* Fortunately, this affected 
a malfunction which was easily described verbally to the subjects • It 
was necessary for logistic and economic reasons to administer both static 
and dynamic tests at one sitting. Since both tests are identical and 
there was a possibility of a learning effect and other variables which 
might influence the outcome, approximately one-half of the subjects were 
administered the static test first and one-half, the dynamic test first. 
For logistic reasons all subjects at a given school were administered the 
two tests in the same sequence. It was necessary, therefore, to divide the 
subjects, by school,^ into thosp who were administered the static test 
first and those who were administered the dynamic test first* The tests 
were alternately administered first unless the size of the two groups 
became unbalanced because of unequal numbers of subjects among the 
schools* If the difference in size of the two groups became too great, 
one test was administered first until the size of the two groups was 
again nearly equal. ' 
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CHAPTER IV 



RESULTS 



rfi.cnnci . ^ ^'^^^ primarily with (1) the existence of a visual 
fdae and relationship to basic electronics knowl- 

r„f! A P equivalence o£ photographs with verbal motion 

cues and dynamic Iwo screen presentations of television malfunctions 
Th^ '^^'^"^ purposes. Some associated questions were also studied. 
Ihe hypotheses are stated explicitly in Chapter II. 

^«e^e '^.^Shty-nine students were tested with the static and dynamic 
tests„ Means of 24.99 for the static test and 26.24 for the "dynamic 
slllT". ''''' ''"^'"^^^ deviations were 6.04 and 5.65 for the 

wcr! r^'n T^T ^^^P^^'^'^i^eiy- The highest attained scores 

scori '''' '"^ °" The range of 

scores was 31 on the static test and 26 on the dynamic test. The mean 

525 Lbl °" '''''' -^98; on the dvnamL. 

o^ L If^rt the results of these tests. A full discussion 

rodder wH h. Z^^'"'"'.''''' '''' presented so that the 

reader will have a better understanding of the tests as the analyses 
of the hypotheses are presented. dudi.y:.i.:. 

^.c^« '^^'^ S^"^^^^ i-caction of the .students and technicians toward the 
^r^L^^'-r''^ T^' ^°"«iderable interest and enthusiasm were shown. 
It was evident that the face validity of . the tests was high. This would 

students h'""' r'^^^" real problems! ManJ of the 

the t^,t Jh'""' '^u ^^^hnicians thanked the author after completing 
the test. This xs in the author's experience, unusual. • 



Table U Statistical Summary of the Static and Dynamics Tests for 
Students 



Measure 



N 

Mean 



Mean difficulty level 



Static Dynamic 



89 I 89 



variance ^6.24 

Standard deviation 5^04 s fiS 

Standard error of measurement 3^46 3*47 

Highest" attained score 39' An 

Range . 3^ 

Reliability K-R #14 ' .723 , ^ggg 

Coefficient of discrimination ,960 '965 



'^98 .525 
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Hypotheses 1 and 2 state that the static and dynamic tests are 
reliable measures. Reliability in this case is interpreted as an indi- 
cation of internal consistency e A reliability index was computed for 
both the static and dynamic tests using the Kuder-Richardson formula 14* 
This gave a reliability index of •728 for the static test and .698 for 
the dynamic test. These reliabilities are only moderately high but are 
acceptable for the purposes of this study; therefore, hypotheses 1 and 2 
are accepted, mile thesa reliabilities are only moderately high, they 
are higher than might be expected for a test of this type for several 
reasons. This type of test has not been used previously, and, therefore, 
the technique and instruments have not been perfected. For example, it 
is not known whether the size of the photograph is critical, how close 
•one must be m order to properly observe the screen for testing purposes, 
or what the best method of presenting motion cues is. 

Several bits of feedback from students and technicians after they 
took the tests may help explain why the reliabilities were not higher. 
Wording of the questions seemed to confuse in two ways. The questions 
were stated in the form: "The most likely cause . . Some students 
and technicians interpreted this to mean the order in which they would 
check out a given malfunction. In many cases a check might be carried 
out to eliminate a possible source of a malfunction simply because it is 
easier to make this check than it is to check out the most probable 
spurce of the malfunction. In actual practice, making these prelimi- 
nary checks prior to checking out the most probable source of a malfunc- 
tion coul^ potentially save considerable time; however, with regard to 
the static and dynamic tests, this procedure could lead to a wrong con- 
clusion. The second difficulty with the wording concerned the manner 
in which the answers were stated, e.g*, if one of the alternative an- 
swer read "defective damper" or "defective damper circuit," there was 
a tendency to read this as defective damper tube since the tube is the 
most probable cause of problems in the damper circuits. This tendency 
to interpret the questions in terms of the most likely component within 
the entire circuit may also have led to faulty conclusions with regard 
to the static and dynamic tests. 

Soma of the subjects apparently failed to read, and, consequently, 
consider, some of the cues when selecting an answer. This was true of 
the audio cues on both tests and either the motion cue or some other 
pertinent cue in the photograph on the static test. There was a ten- 
dency on the part of many subjects, especially the technicians, to want 
to get more information from the schema or to change controls on the 
set before making a choice of answers. This is, no doubt, a normal 
reaction to being faced with a decision-making situation with only 
limited information. 

Part of the analysis concerns the relationships between the static 
and dynamic tests and the RTV test, a test of knowledge of basic elec- 
tronics. Of the 89 students who took the static and dynamic tests, 84 
also took the RTV test. These 84 students were used in the analysis of 
variance tests and in the correlations which were used to test several 
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hypotheses. The change in sample size caused 'only slight changes in 
the means. The means for the sample of 84 appear in Table 2. 

Since each student was tested on both the static and dynamic 
tests at a single sitting, the question of the effect of order of 
testing arises. An effort to control this variable was made- by 
administering each test first to approximately one-half of the students, 
Uie order of testing was tested with an analysis of variance. Table 2 
IS a summary of the cell N's and means for this two-way analysis of 
variance comnarlson^ Table 3 summarizes the results of this analysis 



Table 2 Summitry of Analysis of Variance. Cell Means, and N 



Iconicl tv 

Order of Testing static Dynamic Means 



Static first 


N = 41 


N = 41 






X = 25.000 


X = 26.146 


X ' 25.573 


Dynamic first 


N = 43 


N « 43 






X = 25.186 


X = 26.303 


X » 25.744 


Means 


X = 25.090 


X * 26.220 


X - 25.660 


Tab la 3* Analysis 


of Variance Summary, 


Order of Testing and Iconicity 



Degrees of Mean 
5"""''" Freedom Square F Ratio Probability 



Iconicity 

(Static/Dynamic) I 82 53.720 . 7.88 < .01 

Interaction 1 82 .00984 .00139 > .05 

Order of testing I 82 " 1.227 .0189 > .05 



^^H^ " from Table 3, the analysis shows an F ratio of .0189 for 

the 05 l^v^f'"V f ' ''""^^ significant at 

t e 05 level. Therefore, order of testing made no difference, i.e., 

%T ^^g"^^^""*^ learning or practice effect from having been 
administered the static or dynamic test first. 
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Hypotheses 3 and 4 stated that the technicians would do signifi- 
cantly better than graduating students on the static and dynamic tests. 
The statistics for the static and dynamic Cests for the 24 technicians 
are summarized in Table 4, 



Table 4. Statistical Summary of the Static and Dynamic Tests for 
Technicians 



"^^s^" Static ' Dynamic 



N 24 24 

^'^ean 32.13 33.29 

Variance 33.24 35.61 

Standard deviation 5.77 5^97 

Standard error 3.32 3 26 

Reliability K-R //14 ^740 - ^779 



A summary of the analysis of variance is found in Table 5. It 
can be seen from this table thac the technicians did significantly 
better than the students » supporting the hypothesis of construct valid- 
ity. The B i-atio of 29 for this test is significant beyond the .01 
level. The hazards of drawing conclusions from small samples is recog- 
nized; however, the sample is nearly large suatistically , and the dif- 
ference is very highly significant. 

Table 5. Analysis of Variance Nummary, Validity and Iconicity 



Degrees of Mean 
Source Freedom Square F Ratio Probability 



Iconicity 

(Static/Dynamic) 1 106 70.0416 10.02 '< .01 

Interaction 1 106 .0119 ^ > .05 

Validity 
(Students/ 

Technicians) 1 106 1854.3065 29.00 < .01* 



it 

This ist.a one- tailed test. 
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Since the intended purpose here is triL-rdy to show thai thv Vc-cbnicians 

for Che purpose of this study, it is concluded.- there for.., ihai the 
static and dynamic tests are valid measures and chat h.poLhcSes 3 and 
4 are accepted, 

irn.,vJ/f '^'^^'^ photographs with v..a.al motion cues a^e 

visually diagnosing television receiver difCicuUies, . A produet- 

ITff '""u"^^''"" °^ '^^ ''^^ t^h. static and dvnamic 

tests This IS a rather high correlation indicarins o stjong relation- 
ship between the two tests and supporting the hypothesis oi equivnUnco 
I rL ^ I ' l^^^"^^^' ^'ouvvcr, in that the 

H^^i ?? ^^,fP"'^^°"«l>' high. The highest correlation that 
is theoretically possible between the two .tests is the- squc^ro root of 
the product or their reliabilities. In this cace the square root of the 
pro uct of .723 and .698 would give .71 .,s th. highest corre lation hoJ 
could reasonably bo expected between the two tc-sts. rh. obtained 
^ri^c "'^y ""'^ unrealistic, however, because the instru- 

n^^f testing techniques have not been perfected; as the reliabilities 
inn^iv. r T ^'"P'^T' Z'*^ correlation between the ce.ts should also 
improve. If the correlation beti^een the static and dynamic tests is 

obtlin'f .pH/'?"r'^°"' ^ "'^'^^^^"o" slightly greater than unity is 
roiL n-./ f . ""'^ ^° suspect that the assumptions underlying the 
reliabilities have been violated. In this case the reliabilities were 
found with the Kuder-Richardson formula 14, which assumes that the tests 
are measures of a single factor and have inter-item correlations. It will 
ILTT. ' '''"f discussion that the static and dynamic tests are not 
measures of a single dimension, and an examination of the item inter- 

f''^' '^''y considerably. If the assumptions of 

the formula are violated, the reliabilities ^re underestimated. Under- 
estimated reliabilities could account for the corrected correction's 
exceeding unity, and the highest theoretical correlation possible 
between the static and dynamic tests would also be underestimated This 
evidence xndicates that the obtained correlation of .81 between the 
static and dynamic tests may nof be unrL'alistic and may. in fact, be an 
underestimate of the correlation corrected for attenuation. A high 
correlation between the static and dynamic tescs is strong evidence of 
hypoIhesT additional support for the 



.,.A A ^^^^"^^""^1 tests of hypothesis 5, the equivalence of the static 

ofvarZL' "^'"S '''''y''' of'variance. One analysis 

of variance comparison of the static and dynamic tests which included 
SiL ^ 7"«« " ^^"•^'^i^d in Table 3. This comparison gave an F 
Inr^L .1 ' I " significant beyond the ,01 level. The difference 

betweenthe means of the static and dynamic tests in this comparison is 
1.13 points. The static and dynamic tests were also compared as part 
Of the analysis of variance sumnarized in Table 5 and included both 

Lvnnd H of? °f ^"'02. which is Significant 

beyond the ,01 level, was obtained. The difference hocw.en the means 
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of Che stacic and dynamic vcsts in this comparison was 1 14 points. In 
order to be equivtleat, tescs must have equal means and variance and 
have a high correlation (Gullikcen, 1950, pp, 173-192), It can be seen 
that there is onlv partial support from the statistical tests fur ti.is 
hypothesis; thereforu, hypothesis 5 is rejected. As wus pointed out, 
the differences between the means w«>re 1,13 points for the sfidftnts and 
1.14 poinus for che students and technicians combined, tl^is small 
difference might be attributed to factors other than chance. There is 
reason to believe, fcv lixample, that differences in item difficulty 
could be such a factor. Easy or difficult items w)>.ich appear in one 
test but not in the other could have the effect o£ adding or subtracting 
a constant from the mean of the static or dynamic nest, which could 
account for the small differences in this case. If an «asy Item is 
defined as an item marked correctly by 90 percent or more of the subjects, 
then the static and dynamic tests are not equal in this respect. Using 
this criterion, the dynamic test contained three oasy items — number? 
18, 33, and 45. Only one easy item is contained in the static test — 
item 33. Item 18 used loss of vertical -jefJection as the malfunction, 
producing a horizontal white line in the center of a dark scjre^n. 
Item 33 used a dark screen as Che malfunction, and item 45 used a 
defective AGC-sync system as the malfunction. This malfunction caust-s 
.simultaneous vertical and horizontal movement of the nicture. Differences 
of this type could explain the small difference between the obtained 
means. There would appear to be no differcr.^e in the iconic presentation 
of these items unless the subjects missed the motion cue on item 45. A 
horizontal oar or a dark screen is just that, whether it is prec-ented 
by photograph or live screen. 

The difference between the means of the two tests could also be 
explained in terms of iconic differences of tt-e' tests. It should ba 
pointed out that either the live screen or the photographs could have 
been better iconically under the testing conditions in which the static 
and dynamic tests were administered. Since the tests were idantical 
except for the method of presenting the malfunction, any large difference 
in the proportion of students correctly marking an item might be 
attributed to an iconic difference. An examination of the i^m analysis 
(Appendix B) shows that eight items differ by more than .luO in che 
proportion passing on the static and dynamic tests. Item J8 was mark»'cl 
correctly by a greater proportion of the students on the static tt-,^. 
Items 8, 12, 28, 37, 39, 42 and 49 were marked correctly by a gre« liV 
proportion of the students on the dynamic test. Some of these ite > 
used a malfunction which was used in several other que^Jtions. If there 
is an iconic difference for a malfunction, then this difference shoul.'. 
occur in all items using that particular malfunction, and ail of the 
items should agree that one method or pre.senting the malfunction is 
better. For example, if there is an iconic difference between che 
methods of presenting ma .functions , then for three ..terns using the same 
malfunction we would expect to find that a greater proportion of the 
subjects would correctly mark all three items on, say, the dynfl.mic test. 
Sixteen malfunctions were each used in more than one question. Ti.e 
expectations, if an ico.,ic difference exists, are found to hold true 
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for nine of the sixteen malfunctions" that wero used in more ^han one 
question. Two others essentially meet these expoctatioas , and tour do 
not. gr~tke^\even that essentially meet chase expectations, seven 
indicate that the dynamic method is better. Four indicate that the 
static is better. The malfunctions which appear to be iconically better 
in the dynamic test require discriminations of degree such as Xveak 
recept_on, weak video, whether the raster is normal with the absence 
of video, output, etc., and also the dark screen. The static test seems 
to be better for presenting oscillator, power supulv filter, and damper 
circuit problems. 

The criteria of equal means, equal variance, and a high correlation 
are very rigorous requirements for equivalence of tests. Of these require- 
ments the most important is a high correlation, which shows a close 
relationship between the tests. Differences between means can be 
compensated for by adding or subtracting a constant from the means of 
the tests to bring the scores to the same standard score.. Many published, 
well recognized tests do not have equal means on equi\faleat forms of the 
test, and theyuse this procedure. Although the static and dvnamic tests 
do not in the strictest sense meet the requirements of equivalent tests, 
from a practical standpoint the tests are equivalent. 

Hypotheses 6 and 7 state that the static, and dynamic tests are 
measures of a dimension which is independent-^of trade-related cognitive 
knowledge as measured by a paper and pencil test of knowledge of basic 
electronics. The RTV. test is a three hundred-item, multiple choice 
paper and pencil achievement test in radio-television servicing developed 
as a part of the Achievement Measures Project of which this study is a 
part. The RTV test was administered to 149 students and has a mean and 
standard deviation of 114.43 and 39.56, respectively, for this sample. 
Those students who took the static and dy* =imic tests are included in the 
sample. The reliability of the RTV test as measured by the Kuder- 
Richardson 14 formula is ,96. The static test correlated .58 and the 
dynamic .60 with the RTV test. These rather high correlations indicate 
a fairly high degree of relationship of the static and dynamic tests to 
the RTV test; therefore, they are not independent, and hypotheses 6 and 
7 are rejected. It should be pointed out, however, that if these 
correlation coefficients are squared, only about 35 percent of 
the variance of one can be accounted for by the other. This indicates 
a fairly large degree of specificity in the. static and dynamic tests. 
Even though visual diagnostic ability is not entirely independent of 
knowledge of basic electronics, it may still be desirable to test this 
dimension in assessing achievement. 

Hypotheses 8 and 9 state that the static and dynamic tests each 
measure a single dimension. The static and dynamic tests were factor 
analyzed by means of a principal axis factor analysis program with 
varimax rotation to study these relationships. The static and dynamic 
tests accounted for almost equal amounts of the total variance in each 
case. The static test accounted for 26.70 percent of the total variance, 
and the dynamic test, 26.34 percent of the total variance. Table 6 
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Table 6. Percentage of Common Variance Accounted for by Rotated Factors 
for the Static and Dynamic Tests 







^ Factors 






Test 


One" 


Two 


Three 


Four 


Static 


39.07 


21.33 


20.05 


19.54 


Dynamic 


42,07 


20.38 


19.32 


' 18.23 



sunanarizes the percentage of common variance accounted for by each of the 
rotated factors for the static and dynamic tests. The two analyses gave 
results which were quite similar; however, the static test accounted for 
slightly more variance in all cases except factor one. Factor one of the 
dynamic test accounted for slightly more variance than factor one of the 
static test. Although one strong factor is emerging in each c^se, the 
regaining three factors are strong with reference to factor one. On the 
static test, factors two, three, and four accounted for 54.6, 51.3, and 
50.0 percent, respectively, of the amount of variance accounted for by 
factor one. On the dynamic test, factors two, three, and four accounted 
for 48»4, 45.9, and 43.3 percent, respectively, of the amount of variance 
accounted for by factor one. The analyses indicate that the static and 
dynamic tests are not single dimension tests; therefore, hypothesis 8 
and 9 are rejected. 

Hypothesis 10 states that the static and dynamic tests are measures 
of the same dimension. A question was raised concerning whether different 
mental processes are used to solve the various kinds of malfunctions pre- 
sented in the two tests. Several technicians were quizzed on how they 
solved tiie problems on the tests. The process described is as follows: 
examine the set and try to determine what parts or stages are working and 
how well; then eliminate possible sources of the malfunction on the basis 
of knowledge of the relationship between the components and on past 
experience. This is the same process described bjr Miller and Folley (1951) 
and Saupe (1954) and is also the author's opinion of the mental process 
involved — the process of logical reasonings Unless there is some subtle 
difference that is not recognized, the same process is used for all of the 
problems involved in the tests. ^ 

Tliree kinds of problems were used in the tests — those which involved 
the audio (or sound) only, those which involved the video (or picture) 
only, and those which involved both the audio and video output, l^en the 
higher factor loadings (,2 or larger) were examined with reference to the 
kinds .of problems involved, some interesting relationships were revealed. 
Both tests factored in a similar manner on the four factors with regard 
to the type of malfunction used in the questions. Questions which loaded 
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on factor one dealt with all three kinds of malfunctions and in very 
nearly the same proportions in which they were presented within the 
tests as a. whole. Those questions which dealt with stricly video ' 
problems were not quite as heavily loaded on factor one in proportion 
to their occurrence in the tests as a whole., 

- For test security reasons, the static and dynamic tests are not ^ 
included xn this report; however, four sample items and four photographs " 
from the static test are included in Appendix C r.o give the reader some 
xdea of the kxnds of problems used and the quality of the photographs 
For ease of reproduction, the motion cues are given beside the question 
rather than beside the photograph, as was the case in the static test. 

Factor two contained almost equal numbers of pro ems affecting 
the vxdeo only and affecting both the audio and video. Since the tests 
have a hxgher proportioa of problems which affect only the video this " 
would tend to de-emphasize the video type of problems for factor two and 
to emphasize those problems which affect both the audio and the video. 

Factor three contained almost entirely video problems alone. 
One audio problem loaded on this factor on the dynamic test only. 

Factor four contained all three types of problems, but it appears 
to contain a relatively large proportion of audio problems. Three-fourths 
of the audxo problems loaded on this factor, while proportionally only 
one-tnxrd to one-half of the video and audio-video problems loaded on 
this factor. It is difficult to tell if this is an indication that the 
audxo xs the strong element in this factor or if it is similar in 
character to factor one with slightly different emphasis. There were 
only four questions -which dealt with strictly audio problems, and. hence, 
a small change here would make it appear that a much greater emphasis is 
on audxo problems than is actually the case. 

As just discussed, there was some indication that the factors 
contained different kinds of problems in different proportions. The 
xtems were summarized according to the effect the malfunction had on 
tne audxo and video output. This raised the question about whether 
tue source of the malfunction had any relationship- to the factor upon 
which an item loaded. The items were summarized. according to the source 
of the malfunction as indicated by the correct ansx^er to the question. 
No particular relationship seemed to b.e indicated between the source 
of the malfunction and the factor upon which the item loaded. 

Since the items did not load with equal magnitude on the static 
and dynamic tests for a given factor, an attempt was made to summarize 
tne data by ranking the loadings for each item. Tlie loadings for each 
Item were ranked so that the highest loading for an item was ranked one; 
the second highest, two; the next, three; and the lowest loading, four, 
Ihese ranks were then summarized. When summarized in this manner, about 
two-thirds of the items loaded identically for the suatic and dynamic 
tests on their highest (first ranked) loadings. In some cases the 
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•difference between a one rank and a two rank is small, and if these 
items are also* considered, then the proportion would go a little higher. 
About 20 of these items are located in factor one, with progressively 
fewer items in the other factors. Six of the second-ranked loadings 
and five of the third-ranked loadings were on identical items on the 
two tests. 

Evidence has been cited here which indicates that the items 
loaded on the factors in a similar manner on both tests with regard to 
the relative magnitude of the loadings and the types of malfunctions. 
This suggests that the tests are measures of the same dimension. The 
static and dynamic tests correlated in a similar manner with the RTV 
test which gives further support to the acceptance of hypothesis 10. 
The static test, correlated .58 and the dynamic test .60 with the RTV 
test. This evidence, with the evidence previously sighted, seems to 
indicate that the static and dynamic tests are measures of the same 
dimension; therefore, hypothesis 10 is accepted. 

The evidence is not conclusive, so caution must be exercised in 
interpretation of the factors. Tentatively, factor one is named the 
general visual diagnostic factor. Factor two is tentatively named the 
video-audio factor, and factor three, the video factor. Evidence is not 
sufficient to place a name on Jactor four. 
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CHi\?TER V 



. Sim^ilY AiND CO^^CLUSXONS 



Summary 



This research centered around two major problems: (1) to develop 
an achievement test to measure the additional dimension of visual 
diagnostic ability and (2) to test the iconic equivalence of photographs 
with motion cues and live screen presentations of defective television 
reception for testing purposes. Related questions, concerning reliability 
validity, and the dimensions of visual diagnosis were also studied, * 



Method of Study 



A panel of radio-television instructors and technicians was 
utilized to write questions and judge .the appropriateness of itemk for 
the test* The malfunctions were wired into a Tele-Lab trainer so that 
they could be sxg^itched in, at will, for presentation during the test. 
Fifty multiple-choice questions representing 27 malfunctions were used. 
The malfunctions affected' the audio only, the video only, or both the 
audio and the video. This test is the Visual Diagnostic Test for 
Television Servicing-Dynamic, or the dynamic test. The live screen 
used in the dynamic test served as the photographic model for the 
Visual Diagnostic Test for Television Servicing-Static, or the static 
test. Verbal motion cues were presented beside each photograph on the 
static testr The static and dynamic tests were identical except for 
the method of presenting the visual information in the malfunctions. 
To equalize the two tests, a statement of the audio condition was 
presented x>7ithin each question. 

The static and dynamic tests were administered to 89 students 
who were completing one-year programs in radio-television servicing ♦ 
For economic and logistic reasons, the students were administered both 
the static and dynamic tests in one sitting. They were divided into 
two groups so that approximately one-half of them took the static test 
first and one-half took the dynamic test first. The students also 
took, at a different sitting, a three hundred-item, multiple choice 
test of knowledge of basic electronics, the RTV test. 

The static and dynamic tests ;>r7ere also administered to a sample 
of 24 technicians who v/ere employed full- time in radio- television servicing^ 
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Results and Conclusions 



Hypotheses 1 and 2 stated diat the static and dynamic tests are 
reliable. The Kuder«Richardson formula lA yielded a validity index of 
*728 and .698, respectively, for the static and dynamic tests This is 
a moderately high reliability; however, since the equipment and testing 
procedures have not: been perfected, this reliability was considered 
^ adequate. Hypotheses I and 2 v7ere accepted. 

Hypotheses 3 and 4 stated that the static and dynamic tests are 
valid measures Students and technicians were compared using analysis 
of variance. An F ratio of 29 31 was obtained, which is significant 
beyond the .01 level; therefore, hypotheses 3 and 4 were accepted. 

Hypothesis 5 stated that photographs \j±th verbal motion cues are 
equivalent to live screen presentations of defective television reception 
for testing purposes, A product-moment correlation of .81 was obtained 
between the static and dynamic tests. A correlation of ,71 is the highest 
correlation that is theoretically possible between the tests, estimated 
from the reliabilities of the tests, and is less than the obtained 
correlation. When corrected for attenuation, the correlation is slightly 
greater than unity. (The assumptions underlying the reliability formula 
were violated, giving an underestimate of 'the reliabilities. This could 
explain why the obtained correlation was higher than theoretically possible 
and also why the correlation corrected for attenuation is greater than 
unity o) A high correlation was considered to be strong evidence that the 
tests are equivalent. The static and dynamic tests were also compared by 
analysis of variance. F ratios of 7.88 for students and 10.02 for stu- 
dents and technicians were obtained and are significant beyond the eOl 
level. Only partial support v/as given to this hypothesis from the 
statistical tests, so hypothesis 5 was rejected. The requirements of 
equivalence are quite rigorous and are frequently not met by well recog- 
nized tests. The static and dynamic tests do meet the most important 
requirements of equivalence; therefore, from a practical standpoint, the 
tests may be considered equivalent. 

Hypotheses 6 and 7 stated that the static and dynamic tests are 
independent of trade-related cognitive knowledge as measured by a paper 
and pencil test of knowledge of basic electronics (RTV) . The static 
test correlated 58 and the dynamic test .60 with the RTV test. These 
correlations indicate a reasonably strong relationship; therefore, the 
static and dynamic tests are not independent, and hypotheses 6 and 7 
were rejected^. 

Hypotheses 8 and 9 stated that the static tests each measure a 
single dimension. The tests were factor analyzed using a principal axis 
factor analysis with varimax rotation. The results of the analysis 
indicate that, on both the static and dynamic tests, factors two, three, 
and four are each about one-half as strong as factor one. This indi- 
cates a more complex relationship rather than a single dimension; there- 
fore, hypotheses 8 and 9 were rejected^ 
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Hypothesis 10 staced that: the static and dynamic tests are measures 
of the same dimension. This relationship was studied with factor analysis. 
The results indicate that the items oi the two tests do load on the factors 
in a similar manner. The factors of the two tests were also similar with 
regard to the kinds of problems that loaded on each of the factors. The 
static test correlated <58 and the dynamic test correlated .60 with the 
RTV test. The results of the factor analysis and the correlations were 
taken as evidence that the static and dynamic tests are measures of the 
same dimension. Therefore, hypothesis- 10 was accepted. 

) 

Implications for Further Research 

1. If visual diagnostic ability is widely tested, suitable 
photographic models and/or live screen equipment must become readily 
available. 

2. If visual diagnostic ability is widely tested, the -instru- 
ments should be broadened and expanded to include a wider range of black 
and white malfunctions and transistor and color circuits* 

3. Technicians expressed much concern about the efficiency of 
the overall trouble-shooting process, of which visual diagnosis is a 
part. The use of photographs coupled with some other device, such as 
a schematic or tab test, may offer premise as a practical method of 
evaluating the overall etficiency of a technician to carry through the 
entire trouble-shooting procedure. This should be researched* 

4. There was a small but significant difference between the 
means of the static and dynamic tests. Additional research should be 
done to ascertain whether these differences can be accounted for by 
such factors as size of photographs or method of presenting motion 
cues. 

5. Additipnal research should be done on the validity of tests 
of 'visual diagnostic ability* The differences found between students 
and technicians could be accounted for by either performance or 
experience. 
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GENERAL TEST DIRECTIONS 



32 



GENERAL DIRECTIONS - STATIC TEST 

This i« a performanc.1 test In television servicing. It 1* dn^igned 
to test the knowledge which you have acquired during your coarse of study. 

This is a timed test. You will have a total .^f SO alnutes to 
complete the entire test. Malfunctions are presented in the photograptis 
at the left. You will be required to exaaine the photograph and detarsilne 
the malfunction from the answers which you have in your test booklet. 

Read all of the answers carefully before choosing an answer. 

The questions on this test are multiple choice and requires you to 
blacken the letter space ou the answer sheet corresponding to the answer 
which is correct or most nearly correct. An example is given below: 

Example: The deci'ial equivalent of 1.16 is; 

A. .00625 

B. .01625 

C. .0625 

D. .625 

The correct answer is C, so C would be blackened on the answer 
sheet as indicated below: 



Illustration of the Answer Sheet 



Do not write in the test booklet. Record all your answers on your 
answer sheets. 

DO NOT TURN THIS PAGE UNTIL TOLD TO DO SO 
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GENERAL DIRECTIONS - DYNAMIC TEST 

_ This ±k a performance test in television servicing. It is designed 
to test the knowledge which you have acquired during your course of study. 

This is a timed test. You will have a total of 50 minutes to 
complete the entire te.t. Malfunctions will be presented on the screen. 
You will be required to examine the screen and determine the malfunction 
fTom the answers which you have in your test booklet. 

Read all of the answers carefully before choosing an answer. 

The questions on this test are multiple choice and require you to 
blacken the letter space on the answer sheet corresponding to the answer 
which is correct or most nearly correct. An example is given below: 

Example: The decimal equivalent of 1/16 is: 

A. .00625 

B. .01625 

C. .0625 

D. .625 

The correct answer is C, so C would be blackened on the answer 
sheet as indicated below: 



Illustration of .the Answer Sheet 



Do not write in the test booklet. Record all your answers on your 
answer sheets. 

DO NOT TURN THIS PAGE UNTIL TOLD TO DO SO 
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APPENDIX B 
C(»fPUTER PRINTOUT 
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APPENDIX C 
SAMPLE TEST ITEMS 
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SAMPLE TEST ITEMS 



35. The most likely cause of the malfunction in Figure #16 with normal 
audio is: 

A. defective video amplifier • 

B. defective horizontal oscillator (Horizontal motion is present.) 

C. defective integrator circuit 

D. defective sync circuit 

37. The most likely cause of the malfunction in Figure #17 with normal 
audio is: 

A. defective integrator circuit 

B. defective vertical oscillator (Vertical motion is presented*) 

C. defective height pot 

D. defective vertical linearity pot 

45. The most likely cause of the malfunction in Figure #24 with normal 
audio is: 

A. defective integrator circuit 

B. defective differentiator circuit (Horizontal and vertical motion 

C. defective DC power supply is presented,) 
defective sync-AGC circuit 

50. The most likely cause of the malfunction in, Figure #27 with normal 
audio is: 

A. increased capacitance in deflection yoke circuit 

B. shorted vertical output winding 
C# defective damper 

D. * defective high voltage rectifier 



In the static test, when a motion cue was necessary, it was given 
beside the photograph' rather than in,.the question. 
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